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(54) Improvements in or relating to image processing systems 

(57) An image sensor (10) which can be fabricated 
using conventional CMOS processes uses a compara- * 
tor circuit (1 8) at each pixel (1 4) having a first input cou- aaa 
pled to a photodetector (16) and an second input 
coupled to a ramp signal generator (30, 32). The ramp 
signal generator (30, 32) is comprised of a counter (32) 
and a D/A conversion circuit (30) with the analog output 
of the D/A conversion circuit (30) forming an analog 
ramp input to the comparator circuit (18). A counter cir- 
cuit (32) can be used to drive the digital side of the D/A 
conversion circuit (30) and configured to count from 0 to 
2 n -1 to 0, N being the resolution of the photodetector 
(16). The output of the D/A conversion circuit (30) 
causes comparator circuit (1 8) to flip when the ramp sig- 
nal is equal to the value of the output from the photode- 
tector (16). The comparator circuit (18), in turn, drives a 
load signal to a register (38) which stores the counter 
values 32 from pixel (14) at the instant the comparator 
18 flips. In this way an A/D conversion of the image data 
takes place. 
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Description 
TECHNICAL FIELD 

[0001 ] The present invention relates in general to an 
image processing system and more specifically to an 
image sensor circuit and related method of converting 
image signals from their analog to digital equivalent by 
placing a comparator circuit at each pixel in the image 
sensor array. 

BACKGROUND OF THE INVENTION 



[0002] Solid state imaging systems have been in use 
for a number of years in high-tech devices such as med- 
ical instruments, satellites and telescopes. More 
recently, imagers have been employed in a wide array of 
mainstream applications such as digital cameras, cam- 
corders and scanners. Most of these applications use 
Charge-Coupled Devices (XCD W ) to build the underly- 
ing solid state image sensors. 

[0003] For various reasons, CCD-based image sen- 
sors are limited or impractical for use in many consumer 
applications. First, CCDs require at least two polysilicon 
layers with a buried-channel implant to achieve their 
high performance, meaning that they cannot be fabri- 
cated using standard CMOS fabrication processes. 
Second, the level of integration that can be achieved 
with CCD-based imagers is low since they cannot 
include the devices necessary to integrate them with 
other devices in the application. Finally, the circuits used 
to transfer data out of the image array to other devices 
on the system board, such as Digital Signal Processors 
("DSPs") and other image processing circuits, have a 
large capacitance and require voltages higher than the 
other circuits. Since the currents associated with charg- 
ing and discharging these capacitors are usually signifi- 
cant a CCD imager is not particularly well suited for 
portable or battery operated applications. 
[0004] As such, less expensive image sensors fabri- 
cated out of an integrated circuits using standard CMOS 
processes are desirable. Essentially, with a CMOS type 
imager sensor, a photo diode, photo transistor or other 
similar device is employed as a light detecting element. 
The output of the light detecting element is an analog 
signal whose magnitude is approximately proportional 
to the amount of light received by the element. CMOS 
imagers are preferred in some applications since they 
use less power, have lower fabrication costs and offer 
higher system integration compared to imagers made 
with CCD processes. Moreover, CMOS imagers have 
the added advantages that they can be manufactured 
using processes similar to those commonly used to 
manufacture logic transistors. 

[0005] An important signal processing circuit is the 
analog to digital converter ("ADC"). In the last few years, 
CMOS imagers have been developed with the ADC on 
the imager itself. The optimal place for the ADC is 



immediately after the photosensor, (i.e. on the pixel 
itself). An example of a prior CMOS image sensor is 
described in the article entitled "A 128 by 128 Pixel 
CMOS Area Image Sensor With Multiplex Pixel Line 

5 A/D Conversion", IEEE 1996 Custom Integrated Cir- 
cuits Conference, Yang, David X.D., Fowler, Boyd, 
Gamal, EL Abbas. In their article, the authors describe 
an image sensor consisting of an array of pixel blocks 
wherein each block further consists of a group of four 

,o nearest neighbor pixels sharing a single Analog to Dig- 
ital ("A/D") converter. 

[0006] A limitation inherent to such sensors is the use 
of over-sampling A/D conversion methods which require 
a clock rate well above the image frame rate. The need 
15 to keep the conversion rate high in such image sensors 
requires a substantial amount of drive current making 
the sensor impractical for many mainstream applica- 
tions including battery powered or portable devices. 
[0007] Another problem common to prior art CMOS 
20 image sensors is the amount of fixed pattern noise due 
to beta variations from pixel to pixel which can often be 
seen with the naked eye. Other undesirable features of 
prior art CMOS image sensors include large compara- 
tor offsets, high complexity of the A/D conversion cir- 
25 cuitry, high power dissipation and the inability to achieve 
a non-linear response for certain applications. 



SUMMARY OF TH£ INVENTION 

30 [0008] In accordance with the present teachings, the 
disadvantages and problems associated with the prior 
CMOS image sensors are substantially reduced or elim- 
inated. 

[0009] According to one embodiment, disclosed is an 
35 image sensor which can be fabricated using a conven- 
tional CMOS process. A comparator circuit is placed at 
each pixel having a first input connected to a photodi- 
ode, photo transistor or other similar light detecting ele- 
ment, and a second input connected to a ramp signal 
40 generator. Since the comparator circuits are relatively 
simple devices, they are small enough to be fabricated 
within individual pixel cells and are effective at eliminat- 
ing the noise associated with prior art conversion tech- 
niques. 

45 [001 0] In another embodiment, a ramp signal genera- 
tor is provided that comprises a Digital to Analog Con- 
version "DAC" circuit that drives one input of the 
comparator circuit. A counter can be coupled to the dig- 
ital side of the DAC circuit and configured to count from 

so 2 N1 to 0, N representing the resolution of the light 
detecting element. 

[001 1 ] In one embodiment, the pixels are arranged in 
a two-dimensional array of columns and rows. For each 
row of pixels, the counter drives the DAC circuit which, 
55 in turn, outputs an analog signal proportional to the 
value received from the counter. A converter and regis- 
ter are connected so that the output of the counter 
drives the register, and the load signal of the register is 
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connected to the output of the comparator circuit The 
output of the DAC circuit is fed to the comparator circuit 
which flips when the ramp signal equals the value of the 
light detecting element. The counter value loaded into 
the register at the time the comparator flips is the digital 5 
representation of the analog output of the light detecting 
element. 

[001 2] In another embodiment, the ramp signal can be 
generated by other means, such as a capacitor fed by a 
constant current source, the output of the capacitor 10 
being followed by a unity gain voltage buffer whose out- 
put is the ramp signal. 

[0013] In another embodiment, when a non-linear 
response is desired, a programmable memory means 
such as ROM, EEPROM, or RAM may be employed to is 
store values corresponding to the desired response 
curve. The values may be loaded into the DAC circuit 
and converted as herein described to obtain a non-lin- 
ear response. 

[0014] According to another embodiment, each com- 20 
parator circuit is reset to eliminate variations in compa- 
rator offsets by resetting the pixels to their settling or 
zero light value prior to the analog digital conversion 
sequence. 

[001 5] According to another embodiment, a single D/A 25 
conversion circuit is associated with the entire pixel 
array which may consist of N by M pixels. The D/A con- 
version circuit drives only a single row at a time with the 
corresponding comparator circuit in that row driving the 
associated register loads at one time. 30 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0016] The present invention will now be further 
described, by way of example, with reference to certain 35 
exemplary embodiments illustrated in the accompany- 
ing drawings in which: 

Figure 1 is a block diagram of a CMOS A/D per 
pixel imager for a 2 x 2 array; 40 
Figure 2 is a schematic diagram of a circuit for sin- 
gle pixel at row M column N; 
Figure 3 is a block diagram for the register load sig- 
nal pre-charge circuit; 

Figure 4 is a block diagram of a sample D/A conver- 45 
sion circuit with output weighting for each bit D1 :D8; 
Figure 5 is a chip-level block diagram of a per pixel 
imager; 

Figure 6 is a timing diagram for the pixel readout 
sequence corresponding to a single row within the so 
imager; and 

Figure 7 is a timing diagram for the RESET and 
EXPOSE signal sequences. 

[001 7] Numerals in the figures refer to corresponding 55 
parts in the description unless otherwise indicated. 



DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

[001 8] Figure 1 is a block diagram of a CMOS A/D per 
pixel imager 10. As shown, a pixel array 12 comprises a 
plurality of pixels 14 arranged in a two-dimensional 
array of columns and rows. Within each of the individual 
pixels 14, a photodetector 16 is predisposed to receive 
light when exposed to a light emitting source. The pho- 
todetector 16 can be a photo-diode, photo-transistor or 
other similar device as is known to those of ordinary 
skill. 

[001 9] The output from the photodetector 1 6 is a first 
input to the comparator circuit 18. A second input into 
the comparator circuit 18 comes from the Digital to Ana- 
log ("D/A") conversion circuit 30 whose output on the 
comparator circuit side is an analog signal. As shown, a 
counter circuit 32 is coupled to the D/A conversion cir- 
cuit 30 through the bus 34. Preferably, the width of bus 
34 is n bits with stet corresponding to the resolution of 
the photodetector 1 6. A clock signal 36 is applied to the 
counter 32 which determines the counting rate of the 
counter 32. The output from the counter 32, in turn, 
drives the D/A conversion circuit 30 which controls the 
magnitude and rate of change of the analog signal out- 
put from the D/A conversion circuit 30. The speed of 
clock signal 36 determines the slope of the analog sig- 
nal. 

[0020] For each pixel 14, a comparator circuit 18 is 
attached to both the photodetector 16 and the D/A con- 
version circuit 30 as shown. In one embodiment, the 
output of the D/A conversion circuit 30 is a ramp signal 
that reaches the value of the output of the photodetector 
16 at some point in time. 

[0021] The output of each comparator circuit 18 acts 
as a load signal for registers 38 through switch 20. The 
registers 38 load the value of the counter circuit 32 at 
the moment that the output of the D/A conversion circuit 
30 equals or exceeds the output of the photodetector 
16. At this time, a conversion of the analog signal from 
the photodetector 16 is converted to its digital equiva- 
lent as represented by the count of counter 32 on signal 
34. This is done for all pixels 14 in columns 1 through N 
in a row M at the same time in parallel. The conversion 
is done for each row sequentially, preferably for all pixels 
14 in columns 1 through N in a row M at the same time 
in parallel. Thus the conversion is done for each row 
sequentially. 

[0022] Preferably, the D/A conversion circuit 30 drives 
only one row of pixels within the array 12 at a time. It 
should be understood, however, that more or less pixels 
within the array 1 2 may be read during a given cycle and 
that the reading sequences may vary. Thus, a single 
pixel or the entire image may be read during a single 
cycle according to various embodiments. 
[0023] As shown, a pixel RESET signal 26 is coupled 
to each of the photodetector s 16 within the array 12. 
Pixel RESET 26 provides a way of canceling offsets to 
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limit the differences, or offsets, among individual com- 
parator circuits 18 and photodetectors 16 within the 
pixel array 12. The offsets in the comparator circuits 18 
are canceled and photodetectors 16 by pixel RESET 26 
greatly reduce or even eliminate the fixed pattern noise 5 
associated with pixel cells 14. Preferably, the pixel 
RESET 26 places the pixels 14 in the array 12 at their 
settling or zero light value prior to activation of the D/A 
conversion circuit 30. While this technique permits each 
comparator 18 within individual pixels 1 4 to be adjusted 10 
to compensate for offsets in both 1 6 and 1 8. it should be 
understood that additional methods of fixed pattern 
noise cancellation may be utilized. 
[0024] Turning next to figure 2. a schematic diagram 
for an individual pixel 14 of the pixel array 12 is shown 15 
having two voltage bias inputs V bias and The bias 
voltages (Vt^, V logv ) are the same for every pixel. Pref- 
erably, Via* is the minimum expected voltage output 
achievable by an individual comparator circuit 18. V^, 
on the other hand, should be one CMOS threshold volt- 20 
age below the supply rail . 

[0025] As shown, a photo-diode 1 6 is used as the pho- 
todetecting element. The EXPOSE signal 24 connects 
the photo<liode 16 to comparator 18 through transistor 
M2. Preferably, a pixel RESET 26 is asserted prior to 25 
the EXPOSE signal 24. As shown, a pair of complemen- 
tary NMOS transistors (M3, M4) may be used in the 
comparator circuits 18 to receive the outputs from the 
photo-diode 16 and D/A conversion circuit 30. 
[0026] For D/A output signals greater than the output 30 
from the photo-diode 16, the output at row M column N 
is a logical zero. As a D/A output is decreased to a value 
equal to the photo-diode output, the inverter formed by 
transistors M7 and M8 is flipped. 

[0027] While the row signal is an NMOS passgate 50 35 
which can easily pull the pixel output LOW, it is not suf- 
ficient for pulling rt HIGH. As such and according to one 
embodiment, every column output 40 is pre-charged 
high by the corresponding register 38 and then pulled 
low when the comparator 18 flips. 
[0028] An example of a register load signal pre-charge 
circuit suitable for this purpose is shown in figure 3 and 
denoted generally as 70. An individual register 38 is 
pre-charged using the pull-up transistor 72 to bring the 
column line output 40 HIGH prior to flipping of the com- 45 
parator circuit 18. This permits the pixel 14 to pull the 
column line 40 LOW at the appropriate time as deter- 
mined by the row select switches 20 and the clock cycle 
36 of the counter circuit 32. Preferably, all pixels 14 in a 
row are read at the same time by loading the outputs so 
from the corresponding comparators 18 into the regis- 
ters 38 during a single cycle. In one embodiment, row 
select signals (Row1 , Row2) are provided to activate 
the read sequence after RESET Other methods of 
reading the pixel outputs can be devised within the 55 
scope of the present teachings. 
[0029] Register 38 can be designed to loads D )N on 
the rising edge of LD. If so. once LD is HIGH, it will not 



load new data until LD goes LOW and then goes HIGH , 
again. 

[0030] Figure 4 is a circuit diagram for a suitable D/A 
converter circuit 30 for use in an image sensor accord- 
ing to one embodiment. The D/A convertor circuit 30 
must be monotonic with a continuously decreasing out- 
put. The output of the D/A convertor circuit 30 is 
dependent on the digital bit stream sequence D1:D8 
delivered by the counter circuit 32. The output of the 
D/A convertor circuit 30 can be non-linear, as long as it 
is still monotonic. if the bit stream D1 :D8 is other than 
step-wise linear. 

[0031 ] In one embodiment, the counter circuit 32 com- 
prises a programmable memory means such as a ROM, 
RAM, or EEPROM device which drive the waveform 
output from the transistors Q1 through Q8 to be linear, 
non-linear or other desired shape. Transistors Q1 
through Q8 can be weighted to give the desired output 
for each bit in the bit input stream sequence D1:D8. It 
should be understood, however, that the D/A conversion 
circuit 30 of figure 4 is but one example of a signal gen- 
erator suitable for driving pixels 1 4. For example, a ramp 
signal generator could be used instead of the D/A con- 
version circuit 30 to provide step output that drives the 
pixels 14 in the array 12. Other methods may be utilized 
as will be apparent to those of ordinary skill. 
[0032] Turning to figure 5, an integrated circuit chip 
CMOS imaging sensor according to one embodiment is 
shown and denoted generally as 100. The N x M image 
array 120 of the chip 100 consist of M rows and N col- 
umns of pixels 14 configured as described above in fig- 
ure 1 with respect to pixel array 12. For the example 
shown in figure 5, a 4 x M imager chip is illustrated with 
4 registers 38 being driven by the image array 120. M 
can be equal to N, but this is not necessary. 
[0033] The imager chip 100 incorporates the control 
logic 102 and shift register 104 which comprise the 
input/output interface for the imager chip 100 and allow 
external control of the chip 100 and general communi- 
cations with external processing systems via the con- 
trol/clock line 106 and data out line 108. respectively. As 
the registers 38 are loaded with pixel array data from the 
image array 1 20. individual image bits are passed to the 
NP bit shift register 104 where N represents the number 
of columns and P represents the number of bits in the 
output sequence from the counter 32. The NP bit shift 
register 104 allows the imager chip 100 to deliver the 
image data to an outside system using output bus 108, 
while the next row of image data is being read out of the 
image array 120. 

[0034] As shown, the control logic 102 receives con- 
trol signals 106 which operate the imager chip 100 
including the counter circuit 32, the NP bit shift register 
104 and registers 38. In one embodiment, the control 
lines 106 consist of a clock, RESET and EXPOSE sig- 
nals. The control lines 106 are used to operate various 
features of the chip 1 00 including the cancellation of off- 
sets, the EXPOSE time cycle of the image array 120, 



4 



7 



EPO 954 167 A2 



8 



and the frequency rate of the clock. It should be under- 
stood, however, that various other functions of the 
imager chip 100 may be controlled via the control lines 
106 depending on the application in which the chip 100 
is used. 5 
[0035] The control logic 102 is shown coupled to the 
NP bit shift register 104 and the registers 38 to control 
the shifting of data to the outside world via bus 106. 
Preferably, the outputs from all pixels in the image array 
120 are switching so that the D/A convertor 30 drives 10 
only one row of pixels at a time and thus, only one com- 
parator circuit 18 within a column will drive a register 
load signal 22 at a time. The reading sequence for pix- 
els in the array 120 can vary depending on how the out- 
puts from the individual pixel cells 1 4 are loaded into the is 
registers 38. 

[0036] Figure 6 is a timing diagram for the pixel read- 
out sequence of an arbitrary pixel in the array 1 20 at col- 
umn N and row M. As shown, the RESET line 26 and 
EXPOSE line 24 stay LOW the entire time. The output 20 
from the D/A convertor circuit 30 is the only analog sig- 
nal in the system, as all other signals including row M, 
register RESET and column N are digital. 
[0037] Column N is the output of the pixel in column N 
and row M and is set HIGH by the register RESET 26. 25 
Assuming the counter circuit 32 counts from its maxi- 
mum value down to 0, the D/A output goes from its high- 
est value to its lowest value. The column N goes LOW 
when the D/A output equals the voltage stored on the 
gate M3, as shown in figure 2. This permits the pixels 1 4 30 
along row M to drive the corresponding register load 
signal 22 at time T4. 

[0038] A timing diagram for the RESET and EXPOSE 
signal sequences is shown in figure 7. In contrast to the 
signal sequence of figure 6, the signals row 1 through 35 
row M stay LOW the entire time while the counter output 
(2 N -1) remains at its maximum value throughout. As 
indicated, the only critical times are T4 and T5. For T4 f 
with the signal pixel RESET going LOW before the 
EXPOSE signal goes HIGH. Likewise, the EXPOSE sig- 40 
nal goes HIGH as soon as possible after the pixel 
RESET goes LOW T5 is the expose cycle time of the 
image array 120. In one embodiment, the time T5 can 
be adjusted according to light level of the image to be 
captured. Thus, the brighter the light, the shorter the 45 
exposure time. 

[0039] While the invention has been described in con- 
junction with preferred embodiments, it should be 
understood that modifications will become apparent to 
those of ordinary skill in the art and that such modif ica- so 
tions are intended to be included within the scope of the 
invention. 

Claims 

55 

1 . An image sensor comprising: 

a ramp signal generator; and 



a plurality of pixel cells, each of the cells com- 
prising; 

a photodetector and a comparator circuit each 
comparator circuit having first and second input 
terminals, each photodetector having an output 
terminal being arranged tor driving a first input 
of a comparator circuit, the plurality of pixel 
cells coupled to the ramp signal generator so 
that analog signals from the ramp signal gener- 
ator drive a second input of a comparator cir- 
cuit, each comparator circuit being arranged for 
delivering an output when the analog signals 
from the ramp signal generator is substancially 
equal to an output from a photodetector, the 
output of a photodetector being a measure of 
light across the photodetector at each pixel 
cell. 

2. The sensor according to claim 1 , wherein said ramp 
signal generator is a Digital-to-Analog Conversion 
circuit fDAC**), said sensor further comprising: 

a counter; and 

a bus forming a signal pathway between the 
counter and the DAC. 

3. The sensor according to claim 2, wherein the width 
of the bus is proportional to the resolution of the 
plurality of pixel cells. 

4. The sensor according to any of claims 1 to 3, 
wherein said plurality of pixel cells are arranged in a 
two-dimensional array of M rows and N columns. 

5. The sensor according to claim 4 further comprising : 

N registers, each of said N registers being 
arranged to be driven by all comparator circuits 
within the same row sequentially in time. 

6. The sensor according to claim 4 or claim 5, further 
comprising: 

a plurality of row select lines, each row select 
line being arranged for driving a series of com- 
parator circuits within the same row so that out- 
puts from pixels cells in a row are sequentially 
loaded into said N number of registers. 

7. The sensor according to any preceding claim fur- 
ther comprising: 

means for coupling a RESET signal to the plu- 
rality of pixel cells. 

8. The sensor according to claim 7, wherein said 
means are arranged such that the RESET signal 
goes HIGH prior to a conversion operation being 
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performed by the DAC. 

9. The sensor according to any preceding claim fur- 
ther comprising: 

a signal line coupled to the plurality of pixel 
cells for controlling the exposure time of the 
photodetectors. 

10. The sensor according to any preceding claim fur- 
ther comprising: 



10 



a memory device coupled to the DAC storing a 
plurality of non-linear values so that the corre- 
sponding analog output from the DAC is non- is 
linear. 

11. The sensor according to claim 10. wherein said 
memory device is programmable. 
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(54) Improvements in or relating to image processing systems 



(57) An image sensor (10) which can be fabricated 
using conventional CMOS processes uses a compara- 
tor circuit (1 8) at each pixel (14) having a first input cou- 
pled to a photodetector (16) and an second input 
coupled to a ramp signal generator (30, 32). The ramp 
signal generator (30, 32) is comprised of a counter (32) 
and a D/A conversion circuit (30) with the analog output 
of the D/A conversion circuit (30) forming an analog 
ramp input to the comparator circuit (18). A counter cir- 
cuit (32) can be used to drive the digital side of the D/A 
conversion circuit (30) and configured to count from 0 to 
2 n -1 to 0, N being the resolution of the photodetector 
(16). The output of the D/A conversion circuit (30) 
causes comparator circuit (1 8) to flip when the ramp sig- 
nal is equal to the value of the output from the photode- 
tector (16). The comparator circuit (1 8), in turn, drives a 
load signal to a register (38) which stores the counter 
values 32 from pixel (14) at the instant the comparator 
1 8 flips. In this way an A/D conversion of the image data 
takes place. 
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